Surgical Gesture Segmentation and Recognition

نویسندگان

  • Lingling Tao
  • Luca Zappella
  • Gregory D. Hager
  • René Vidal
چکیده

Automatic surgical gesture segmentation and recognition can provide useful feedback for surgical training in robotic surgery. Most prior work in this field relies on the robot's kinematic data. Although recent work [1,2] shows that the robot's video data can be equally effective for surgical gesture recognition, the segmentation of the video into gestures is assumed to be known. In this paper, we propose a framework for joint segmentation and recognition of surgical gestures from kinematic and video data. Unlike prior work that relies on either frame-level kinematic cues, or segment-level kinematic or video cues, our approach exploits both cues by using a combined Markov/semi-Markov conditional random field (MsM-CRF) model. Our experiments show that the proposed model improves over a Markov or semi-Markov CRF when using video data alone, gives results that are comparable to state-of-the-art methods on kinematic data alone, and improves over state-of-the-art methods when combining kinematic and video data.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Accelerometer Based Real-Time Gesture Recognition

Gesture is a natural expression form for humans, but its recognition is a similarly hard problem as speech recognition. In this paper, I present a real-time hand gesture recognition system, which identifies relevant parts in the continous sensor data stream, and classifies them to the most probable gesture. Instead of the usual button-based segmentation, I have created an automatic segmentation...

متن کامل

Gesture Segmentation Using an Adaptive Threshold Algorithm

Hand gesture segmentation is a key step for gesture recognition. Based on the construction of a new color space of skin model, a new dynamic-thresholding segmentation approach named Adaptive Threshold Segmentation Algorithm (ATSA) was further developed and segmentation effect evaluation was conducted. Some images of hand gesture were processed by using ATSA and the Fixed Threshold Segmentation ...

متن کامل

Large-scale Continuous Gesture Recognition Using Convolutional Neutral Networks

• General method description:This paper addresses the problem of continuous gesture recognition with convolutional neutral networks (ConvNets) using depth maps sequences. Unlike the common isolated recognition scenario, the gesture boundaries are here unknown, and one has to solve two problems: segmentation and recognition. For segmentation, we first obtained the begin and end frames of each ge...

متن کامل

Face Recognition Using YCbCr and CIElab Skin Color Segmentation Methods:A Review

Skin Color segmentation plays an important role in various applications such as face recognition, gesture recognition, human computer interaction etc. Face recognition is of main concern in skin color segmentation. There are various color models used for skin color segmentation (YCbCr, HSV and CIELAB) but appropriate method should be used for skin color segmentation. In real time the main probl...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

دوره 16 Pt 3  شماره 

صفحات  -

تاریخ انتشار 2013